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Abstract. For any field fc and any integers m, n with ^ 2m ^ 
n + 1, let W n be the fc- vector space of sequences (xq, . . . , x n ), and 
let H m C W n be the subset of sequences satisfying a degree-m linear 
recursion, i.e. for which there exist do, . . . , a m £ k such that subset 
of sequences satisfying a degree-m linear recursion — that is, for 
which there exist do, ■ ■ ■ , a m € k, not all zero, such that 



holds for each j = 0, 1, . . . , n — m. Equivalcntly, H m is the set of 
(xo, . . . , x n ) such that the (m + 1) x (n — m + 1) matrix with (i, j) 
entry Xi + j (0 ^ i ^ m, ^ j ^ n — m) has rank at most m. We 
use elementary linear and polynomial algebra to study these sets 
H m . In particular, when A: is a finite field of q elements, we write 
the characteristic function of H m as a linear combination of char- 
acteristic functions of linear subspaces of dimensions m and m + 1 
in W n . We deduce a formula for the discrete Fourier transform of 
this characteristic function, and obtain some consequences. For in- 
stance, if the 2m + 1 entries of a square Hankel matrix of order m + 1 
are chosen independently from a fixed but not necessarily uniform 
distribution // on k, then as m — > oo the matrix is singular with 
probability approaching 1/q provided < q 1 ^ 2 . This bound q 1 / 2 
is best possible if q is a square. 

Introduction 

Fix a field fc. For any integers m,n with ^ 2m ^ n + 1, let W„ be the 
fc- vector space of sequences (#0, ...,x n ), and let 7J m C W n be the subset of 
sequences satisfying a degree-m linear recursion, that is, for which there exist 
ao, . . . , a m € fc, not all zero, such that 



m 




m 




(1) 



holds for each j — 0, 1, . . . , n — m. Equivalently, H m is the set of (xq, . . . , x n ) 

1 Supported in part by the Packard Foundation, e-mail address: elkies@math.harvard.edu 



such that the (m+1) x (n — m + 1) Hankel matrix 



Xl 
X2 



%n—m-\-l 



(2) 



has rank at most m.|^] Now linear recursions on infinite sequences {xijigz are 
known to correspond to polynomials in the shift operators T ±x : {xi} h- > {xi±i}, 
modulo multiplication by powers of T. This approach does not work so nicely 
for finite sequences, because T and T -1 push xq and x n off the edge. We propose 
to remedy this problem at T — 0, oo by homogenizing: instead of polynomials 
in T ±:L , use homogeneous polynomials in two variables Y and Z that act on W n 
as the right and left truncation maps to W n -i- We shall see that this approach 
yields a clean account of linear recursions and the subsets H m in the space W n , 
which itself will be identified with the dual of the space V n of homogeneous 
polynomials of degree n in Y and 

In the present paper we develop this account using elementary linear and poly- 
nomial algebra. When A; is a finite field of q elements, we also write the char- 
acteristic function of H m as a linear combination of characteristic functions of 
linear subspaces of dimensions m and m + 1 in W n . We deduce a formula for 
the discrete Fourier transform of this characteristic function, and obtain some 
consequences. For instance we obtain a new proof that #i/ m = q 
show that if the 2m + 1 entries xq , . . . , X2m of a square Hankel matrix 



We further 
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Xl 



Xi 



(3) 



X2r. 
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of order m+1 are chosen independently from a fixed but not necessarily uniform 
distribution /i on k, then asm-too the the matrix is singular with probability 
approaching 1/q provided the Fourier transform of jj, has l\ norm less than g 1 / 2 . 
This bound is best possible if q is a square: if /i is the uniform distribution 

2 For more background on Hankel matrices (matrices with entries constant on NE-SW 
diagonals), and the closely related Toeplitz or "persymmetric" matrices (with entries constant 
on NW-SE diagonals), sector instance W. These matrices arise in diverse mathematical 
contexts; see for instance M, M and the references in H]. In our setting, Hankel matrices are 
more natural than Toeplitz ones, but our results on rank distribution, culminating in Thm. 2, 
apply equally well to matrices of either Hankel or Toeplitz type. 

3 I thank Joe Harris for the geometric observation that H m consists of the lines through 
the origin coming from the points (xo : x\ : ■■■ : x n ) lying on the m-th secant variety of 
the rational normal curve (§" : £ n— ^fj : — : ff 1 ) in n-dimensional projective space over k. 
We shall not need this formulation here, but it arises naturally in an arithmetic application 
of H m §• 

4 As an added benefit, the whole structure inherits a GL2(fc) structure from the action of 
GL2(fc) by linear substitutions on Y, Z. But this, too, is not needed for the present paper. 
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on ckg, where ko is a quadratic subfield of k and c £ k* is arbitrary, then 
IIa*IIi = 9 1 ^ 2 bvrt the probability is g~ 1,/2 . It seems reasonable to conjecture 
that for any /i the matrix (||) is singular with probability — > 1/g as long as /i is 
supported on a set of at least two elements not contained in cko for any proper 
subfield fco of k. 

The spaces V n ,W n and some linear algebra 

Basic notions and lemmas. Fix a field k. For each integer n > —1, let V n be 

the vector space of dimension n + 1 over fc consisting of bivariate homogeneous 
polynomials 

n 

P(Y, Z)=J2 ai Y l Z n - 1 (4) 

of degree n. Let W n as the dual of V n . We identify W n with the space of 
sequences (xq, . . . ,x n ) by regarding such a sequence as the linear functional 

n n 

a t Y l Z n - 1 » a * x * ( 5 ) 

i=Q i=0 

on V n . Note that we allow V—i and W-i, each of which is the zero space, but 
not V n , W n for n < — 1. 

If to ^ and n + 1 ^ to, polynomial multiplication l^n x Vn-m ~ * gives for 
each Q € a linear map M n (Q) : V n - rn — > defined by 

M n (Q):P^PQ (PeV n - m ). (6) 

Our reason for identifying the space W„ of sequences (xo, . . . , x n ) with the dual 
of V n is the following observation: 

Lemma 1. Suppose Q £ is the polynomial YliLo a>iY % Z rn ~ % . Then the ad- 
joint of M n (Q) is the linear map M*{Q) : W n — * W n - m taking any (xq, ...,x n ) 
to the sequence of length n — m + 1 whose j-th term is 

m 
i=0 

for each j with < j < n — m. 

Proof: We show the equivalent dual statement: the linear map M n {Q) takes 
any polynomial 

n — m 

P(Y,Z) bjY^Z"-™- 1 

3=0 

in V n - m to the polynomial PQ 6 whose F r Z n ~ r coefficient is J2i+j= r 
for each r with ^ r n. But this is immediate from the expansion of PQ. m 

Thus H m is the union of kerM*(Q) over all nonzero Q £ V m . 
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Of course that union is not disjoint, but as long as 2m ^ n+1 we shall describe 
the intersection of kerM*(Qi) and kerM*(Q 2 ) for any Qi,Q 2 of degree at 
most m, see Lemma 4 below. We first establish some further basic properties: 

Lemma 2. i) For any Q,Q' G V m and n such that n + 1 ) m ) we have 



ii) For any Qi G V mi , Q2 G V m2 , and n such that toi,to 2 > and n + 1 ^ 
mi + m 2 , we have 



M*(Q 1 Q 2 ) = M*_ m2 (Qi) o M* n {Q 2 ) = M* n _ mi {Q 2 ) o M*{Q{). (9) 



in) For any nonzero Q G V m and any n > m — 1, the map M*(Q) is surjective 
and its kernel has dimension m. 

Proof: (i) This is the dual of the identity M n (Q + Q') = M n (Q) + M n (Q'), 
which is just the distributive law P(Q + Q') = PQ + PQ' for multiplication of 
homogeneous polynomials. (Alternatively apply Lemma 1.) 

(ii) Likewise this is the dual of the fact that multiplying a polynomial of degree 
n — mi — m 2 by Q1Q2 is the same as multiplying it first by Q2 and then by Qi 
or vice versa. 

(iii) Since k[Y, Z] has no zero divisors, M n (Q) is injective; thus M*{Q) is sur- 
jective, and its kernel has dimension dim W n — dim W n - m = m. m 

The ideal I x . For x = (x , . . . ,x n ) G W n , define I x C k[Y, Z] as follows: any 
Q G k[Y,Z] is uniquely J2m=o Q m w ^ n eacn Q m e V m ] the subset I x consists 
of those ^2 m=0 Q m for which (M*(Q m ))(x) = for each m ^ n + 1. 
Lemma 3. is a homogeneous ideal in k[Y, Z] for all x G W n . 

Proof: By definition X^m=o Qm G if an d only if each Q m G I x . So it is enough 
to check that I x (~l is closed under addition for each m, and that PQ G if 
Q S 7 X n 7 m and P G V^j' for some m, m' > 0. Each of these is vacuously true 
ifm>n+l or m + m' >n+l respectively, and follows from part (i) or (ii) of 
Lemma 2 otherwise. ■ 

The main result of this section is the following partial description of I x , stat- 
ing in effect that it is approximated by a principal ideal as well as dimension 
considerations allow: 

Proposition 1. Suppose for some x G W n that I x contains a nonzero poly- 
nomial of degree at most (n + l)/2. Let m be the smallest degree of such a 
polynomial. Then I x fl V mo is 1-dimensional, say 



M* n {Q + Q') = M* n {Q) + M*{Q'). 



(8) 



Ix n V mo = kQ 



(10) 



for some nonzero Qq G V mo . For each m ^ n + 1 — mo, 



—mo J- 



(11) 
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Remark: In particular, it follows that I x (~1 V m has dimension m — mo + 1 for 
mo $J m ^ n + 1 — mo. This cannot hold once m > n + 1 — mo, except in the 
trivial case x = 0, when mo = and / x is all of k[Y,Z]. Indeed suppose that 
mo > and m > n + 1 — mo . If m > n + 1 then Jj. n V^, = V m has dimension 
m + 1 > m — mo + 1 . If m ^ n + 1 then / a R is the kernel of the linear map 

V m -> W^-m, Q~ (M*(Q))(z); (12) 

thus 

dim(7 a: nV,„) > dim V m - dim W„_ m = 2m - n, (13) 

which again exceeds m — mo + 1 since m > n + 1 — mo . This is what we mean 
when we state that I x approximates the principal ideal (Qo) &s well as dimension 
considerations allow. 

To prove Prop. 1 we must first make good on our promise to describe intersec- 
tions of the spaces ker M*(Q). We do this in the next lemma, whose statement 
uses the greatest common divisor Q of two homogeneous polynomials Qi,Q 2 . 
This is defined only up to multiplication by k* , but such scaling does not affect 
the space ker M*(Q), so the choice of g.c.d. will not affect the result. 

Lemma 4. Let Q±, Qi be nonzero polynomials in V mi , V m2 respectively, with 
greatest common divisor Q. Then, for each n ^ max(mi,m2) — 1, 

ker M*{Q X ) n ker M*{Q 2 ) D ker M*(Q), (14) 

with equality if and only if 

n+ 1 ^ mi +rri2 - deg(Q). (15) 

Proof: Hx € kerM*(Q) then x is in the kernel of both M*(Q±) and M*(Q 2 ), be- 
cause each of these linear maps factors through M*(Q) by part (ii) of Lemma 2. 
Thus x is in the intersection of the two kernels, whence (|l4j) follows. It remains 
to establish the condition of equality. 

Let m = degQ, and m! = mi + m 2 — m. By Lemma 2(iii), the codimensions 
in W n ofkerM*(Qi) and kerM*(Q2) aren+l — mi andn+1 — m-2 respectively. 
Thus their intersection has codimension at most 

(n + 1 — mi) + [n + 1 — 771.2) = (n + 1 — m) + (n + 1 — m). (16) 

Hence if m! > n + 1 then this codimension is strictly less than the codimension 
of ker M* (Q) . Thus the condition m! ^ n + 1 is necessary for equality in (|lj) . 

We conclude the proof by showing that this condition is also sufficient. Let Q' 
be the least common multiple 

Q 1 = Q1Q2/Q (17) 

of Qi and Q 2 \ this is a homogeneous polynomial of degree m! . Assuming that 
m' ^ n + 1, we may then consider M*(Q'). We claim that 

kerM*(Qi) + ker M*{Q 2 ) = ker M*(Q'), (18) 
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By duality, this claim is equivalent to 

im(M„(Qx)) n im(M n (Q 2 )) = im(M n (Q'))- (19) 

But this is just the statement that a polynomial in V n is divisible by both Q\ 
and Q 2 if and only if it is divisible by Q' — which is true because Q' is the least 
common multiple of Q\ and Q 2 . We thus have 

dim(kerM*(Qi) n ker Af*(Q a )) 
= dim(kerM*(Q x )) + dim(ker M*(Q a )) - dim(kerM*(Q x ) + ker M*(Q 2 )) 
= dim(kerM*(Qi)) + dim(ker M*(Q 2 )) - dim(ker M*(Q')). (20) 

By Lemma 2(iii) again, this dimension equals 

m% + m 2 — m = m = dim(ker M*(Q)). (21) 

Since we already know that kerM*(Qi) n kerM*(Q 2 ) contains kerM*(Q), we 
conclude that these two spaces are equal. ■ 

Corollary. Suppose x £ W n . If I x contains homogeneous polynomials 
Qli Q2 whose least common multiple has degree at most n + 1, then I x contains 
gcd(Qi, Q 2 ). In particular, this conclusion holds if degQi + degQ 2 ^ fi+ 1. 

Proof: Under our hypotheses, x is contained in both kerM*(Qi) and kerM*(Q2), 
and the equality condition of Lemma 4 is satisfied. Therefore 

x £ ker M* (Qi) n ker M*(Q 2 ) = kerM*(gcd(Qi, Q 2 )), (22) 

which is to say that I x contains gcd(Qi, Q 2 ) as claimed. ■ 

We can now easily prove Prop. 1. Suppose Qi,Q 2 are nonzero polynomials in 
Ix H V m „ . By the hypothesis of Prop. 1 we know 2mo $S n + 1. The Corollary to 
Lemma 4 thus applies, and we find that I x contains gcd(Qi, Q 2 ). Unless Qi,Q 2 
are proportional, deg(gcd(Qi, Q 2 )) < mo, which is impossible by the definition 
of mo- Thus I x n V mo has dimension 1 as claimed. By the same Corollary, if 
m ^ n + 1 — mo and Q 6 I x n V„ lQ — {0} then I x 9 gcd(Qo7 Q)- Since again 
gcd(Qo,Q) must have degree at least mo, we conclude that Q is a multiple 
of Qq. Since I x is an ideal (Lemma 3), we already know that I x contains all 
multiples of Q ; thus I x D V mo consists of all degree-m multiples of Qo, and we 
are done. ■■ 

It is thus natural to call Qo the minimal linear recursion satisfied by x. (Again 
Qo is defined only up to multiplication by k* .) From Prop. 1 we deduce the 
following description of the degree mo of this minimal recursion: 

Corollary. If x £ H m for some m ^ (n + 1)/2 then the degree of the minimal 
linear recursion satisfied by x equals the rank of the Hankel matrix (^) associated 
to x. 

Proof: Let mo be this minimal degree. The rank of (||) is m + 1 — d, where 
d is the dimension of the kernel of the action of this matrix on row vectors of 



G 



length to + 1. But Lemma 1 identifies this kernel with the space I x (~l V m of 
degree-m recursions satisfied by x. Since too m ^ (n + l)/2, we may apply 
Prop. 1 to find that d — m — tuq + 1. Thus mo is the rank of the Hankel matrix, 
as claimed. ■ 



The characteristic function of H m 

Decomposition into signed linear subspaces. We assume henceforth that 
k is a finite field of q elements. For integers m, n satisfying our customary 
condition 2m ^ n + 1, let P m be the set of all subspaces of W n of the form 
kerM*(Q) for some nonzero Q £ V m . (By Lemma 4 and part (iii) of Lemma 2, 
kerM*(Qi) = kerAf*(Q2) if and only if Qi,Q2 are proportional; thus P m 
consists of 

#(Vm - {0}) _ q m+1 - 1 

#(fc*) - q-1 [23) 

subspaces. We note for later use that this formula remains valid if we allow 
m = — 1, when P m is empty.) Recall that we defined H m as the set of x £ W n 
satisfying a recursion of degree m, and noted that H m is thus the union of all 
the subspaces in P m . We further noted that this union is not disjoint, and 
thus that Xh > t ne characteristic function of H mi is not simply the sum of the 
characteristic functions of the subspaces in P m . However, by Lemma 4, the 
intersection of any two subspaces in P m is again the kernel of M* (Q) for some 
nonzero homogeneous Q of degree ^ to, and more generally if mi, TO2 ^5 m then 
the intersection of any subspace in P mi with any subspace in P m2 is itself in 
P m / for some ml ^ to. Thus we can use inclusion-exclusion identities to write 
Xh as a linear combination of the characteristic functions of subspaces in P m / 
for to' ^ m. Fortunately the resulting formula is quite simple: 

Proposition 2. The characteristic function of H m equals 

KeP m K"eP m _i 

in which j 's the characteristic function of the set K , and the second sum is 
interpreted as zero when to = 0. 

Proof: Clearly (|24|) is an integer- valued function on W n supported on H m . Thus 
we need only show that its value at x equals 1 for all x £ H m . But this value is 

#(4 n v m ) - 1 _ #(4ny m _!)-i 

q-l q q-1 

- 1 + — . (25 ) 

Let Too be the degree of the minimal linear recursion satisfied by x. By Prop. 1, 
I x (~l Kn and I x n V m ~\ are vector spaces of dimensions to — mo + 1 and m — mo 
respectively over k. (Note that this remains true if mo = m, when I x n V m -\ is 
the zero space.) Thus #(I X H F m ) = g #(/ x (~l V m _i), and ( p5| ) simplifies to 1 as 
claimed. ■■ 
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We easily deduce the formula J^, Thm. 1] for the size of H m : 
Corollary. For all nonnegative m ^ (n + l)/2 we have 

#{H m ) = q 2m . (26) 

Proof: The size of H m is the sum of \H m ( x ) over x e W n - By (pif), this sum is 

£ - q J2 (27) 

a'gp,„ ffeP M _i 

But by Lemma 2(iii), each if S P m has size q m , and each if £ P m -i has size 
qm-i Using (|23| ) — and this is where we use the validity of (|23| ) also for m = — 1 
— we thus simplify (^) to 

m+l _ i _m _ 1 

"' q- -q m ~ l =q 2m , (28) 



9-1 9-1 



as claimed. 



In particular, if n = 2m — 1 then #ii m = #W„, whence ii m = W n — which is 
clear because in this case the Hankel matrix (^) has only m rows, so must have 
rank at most m. (This is essentially the special case n — 2m — 1 of the dimension 
count we used earlier to deduce (|T3|); in this case we find that I x l~l V m has rank 
at least 2m — n = 1, so must contain a nonzero vector.) Starting from this, one 
may establish without too much difficulty a bijection from W^m-i to the subset 
H m of W n for any n 2m — 1, even without our fc[Y, Z] framework. (This is in 
effect how (|2^) is proved in 0.) But our approach also yields a formula for the 



Fourier transform Xh i^) f° r all P G T^, whereas (26) only gives x H (0). We 
turn to Xh nex t- 

Discrete Fourier transform. To dehne the Fourier transform on W n , we 
first define it on k. Fix a nontrivial character tJjq of k, that is, a nontrivial 
homomorphism from the additive group of k to the unit circle in C. [If k = Z /pZ 
for some prime p, we may take ipo(x) = exp(27rix/p); in general k contains Z/pZ 
where p is the characteristic of k, and we may take tpo(x) = e?tp(2irit(x)/p) 
where t : k — * Z/pZ is any nontrivial homomorphism of additive groups. One 
common choice for i is the trace from k to Z/pZ. At any rate none of our results 
will depend on the choice of i[>o ■} For any function / : k — > C, we define the 
(discrete) Fourier transform f of / to be the following function from fc to C: 

f(a):=J2f(x)Max)- (29) 

It is known that / i— » / is a linear bijection on the space C q of complex-valued 
functions on k, and that the inverse bijection is given by the Fourier inversion 
formula: 

f(x) = -J2f(a)M-ax). (30) 

oGfe 
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The Fourier transform is defined more generally for finite-dimensional vector 
spaces over k. Let V, W be a dual pair of such spaces, of dimension d. (We shall 
use V = V n , W = W„, d = n + 1.) To each function F : W — > C we associate 
its discrete Fourier transform 

F(a) := ^ F(x)M(a,x})- (31) 

Again F > F is a linear bijection, and in this context the inversion formula 
reads 

^) = ^E^ a ^°Ha,z>)- (32) 
y aev 

To recover from Prop. 2, we shall need one more fact about the discrete 
Fourier transform: 

Lemma 5. For any linear subspace K C W, the Fourier transform of its 
characteristic function \k js ' Xk->-> wnere K 1 - is the annihilator of K 

in V. 

Proof : By definition, Xr-(°) is the sum over K of the character x \— > ipo((a, x)); 
thus Xft-(y) = or according as this character is trivial or nontrivial on K, 
that is, according as a G K x or a ^ if- 1 . ■ 

We can now give our formula for Xn m ■ ^ will be convenient to introduce the 
following notation: for P £ V n and any integer d, define cud(P) to be l/(q— 1) 
times the number of nonzero Q €Vd such that P is a multiple of Q. Equivalently, 
tUd(P) is the number of degree-d factors of P up to k* scaling, and the number 
of homogeneous principal ideals in k[Y, Z] that contain P and have a generator 
of degree d. For instance, ujo(P) = 1, and for all d > — 1, 

q d+l _ i 

Ud(P) = _ 1 [= #(P«t) if 2d < n + 1]. (33) 

Moreover, for nonzero P we have the identity 

« d (P) = w„- d (P), (34) 

due to the bijection Q <-> P/Q between factors of P of degree d and n — d. (The 
notation lo^ is suggested by the omega function in elementary number theory, 
which counts the positive divisors of a given positive integer.) 

Theorem 1. For every m ^ (n + l)/2 and P £ V n we have 

XhJP) = Q m (w m (P) - Wm-iCP)) ■ (35) 

Proof: By Prop. 2 and Lemma 5, this follows from the following observation: 
for any homogeneous polynomial Q of degree at most n, the annihilator in V n 
of kerM*(Q) is the image of M n (Q), which is the space of degree-n multiples 
of Q. Thus when we use (|i|) to expand Xn m as a linear combination of charac- 
teristic functions of annihilators, the number of subspaces in P m or P m _i that 
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contribute a term to Xh (P) * s the number of divisors of P of degree to or m — 1 
up to k* scaling. Each of these terms is q m or — q ■ q" 1 ^ 1 = —q m respectively, 
whence the formula (|35|). ■■ 

As promised, Prop. 2 is the special case P = of this formula (cf. (^)). Also, 
if n = 2m — 1, the identity ( |34| ) yields Xh (P) = for all P 7^ 0, consistent 
with H m = W n in that case. 



Hankel matrices with independently biased entries. The formula fl26|) 
can be interpreted thus: if xo, • • • , x n are chosen independently at random from 
the uniform distribution on k, then the resulting vector (xq, . . . , x n ) is in H m 
with probability g 2m-(n+i)_ Using Thm 1 

we can also get at the probability 
that (xq, . . . , x n ) £ H m if the X% 9X6 still chosen independently at random but 
from distributions /ij on k that are not necessarily uniform. 

We regard the /x^ as functions from k to R satisfying the conditions: (Ai(x) 
for all x S k, and 

[&(0)=] ^ W (x) = l. (36) 
Then the probability that x :— (xq 7 . . . , x n ) is in H rn is 

n 

Il m (no, ■ ■ ■ ,Hn) = ^2 XH m (^)Y[^( x i)- ( 37 ) 

x£W n 2=0 

By applying Fourier inversion to Xh we can express this as a linear combination 
of the values of x H (P). The resulting formula is: 

Lemma 6. We iiave 

n 

n ro ( Mo ,... ! Mn)=r ( " +1) Yl XnjnllM-^), (38) 

where a% is the Y l Z n ~ l coefficient of P as in (jij). 
Proof: By Fourier inversion (|3^), 

n m ( / , ,..., M „) = g-("+ 1 ) £ je ffm (p) I E M-(^))fl^)) • (39) 

Now (P, x) = I]"=0 a i X »' so 

n n 

tp (-(P, x))JJ/i i (x i ) = JT ip {-aiXi)ni{xi). (40) 

i=0 i=0 

Thus the inner sum in (|3^) factors into 

n / \ n 

IT ( 5Z ^oi-aiXijfiiixi) J = IjMi(-ai). (41) 

z=0 VxiSfc / i=0 
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Entering this into ( |39| ) yields the claimed formula (|3 
The term P = in (||) contributes 



er (n+1) Xtf m (0)n&(0) = c? : 



2m-(n+l) 



(42) 



because X# m (0) = g 2m and each ju,(0) = 1. The absolute value of the sum of 
the remaining terms is at most 



q n+1 sup 

P6V„-{0} 



\x h jp)\ • e ni^(- a ») 



<T" +1 sup |xn m (^)l 
Pev„-{o} 



^ev re -{o} i=o 



iiiNii - 1 

Vi=0 / 



where 1 1 1 1 1 is the l\ norm 



Since jttj(O) = 1, we have ||/tj 



E l^( a ) 



(43) 



(44) 



1^1, with equality if and only if pi (a) = for all 
a ^ 0. By Fourier inversion (30|), this condition is equivalent to fXi(x) = X/q for 
all x. Hence \\fii\\i = 1 if and ony if \ii is the uniform distribution on k. We may 
thus regard (n"=o II Mi Hi) — 1 as a measure of how far the product distribution 
Ho 4 • • fJ-n departs from uniform distribution on W n . 

What of the other factor sup P ^ \xH m (P)\ m the error estimate (Q)? By 
Thin. 1, each Xn m (P) is a multiple of q m . Once n 2m, we cannot expect 
Xij m (-P) to vanish for all P ^ 0, so sup P ^ \x Hm {P)\ must be at least q m . We 
next show that it \x H (P)\ is never much larger than q m for P^O: 

Lemma 7. For every q and e > 0, there exists an effective constant C such 
that 

u d {P)<C{l + e) n (45) 
for every nonzero P G V n and every integer d. 

(This is analogous to the standard fact that the number of factors of an n-digit 
integer is subexponential in n, and will be proved in the same way.) 

Proof: Define 



d=0 



(46) 



the total number of divisors of P up to k* scaling. Factor P into irreducibles 
over k: 



p = n p * 



(47) 
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with P s distinct irreducibles of degree f s . Comparing degrees in ( [47] ) we find 

r 

n = J2e s fs. (48) 

s=l 

Now 

r 

^(^)=n^ +i )' ( 49 ) 

s=l 

because the general divisor of P is nl=i -P» s with each chosen from among 
the e s + 1 possibilities 0, 1, ... , e s . Fix mo large enough that 2 1 / m ° < 1 + e, and 
factor (^|) as 

w(p)= n (e a +i) n ( 5 °) 

fs<m /,^mo 

The second product is at most 

FJ 2 Cs = 2 E/ ' >m ° es 2™ /m °, (51) 

since m l]/ a > mo e s < 2l=i e s/s = n by @. The first product in @ has 
at most -B factors, where B is the number of irreducible bivariate homogeneous 
polynomials of degree < mo up to k* scaling. Each factor is at most n + 1, so 
the product is at most (n + l) B . Since log(n + l) B — o(n) as n — ► oo, and 
2 i/m < l + £; we conclude that 

w(P) < 2 n / mo (7i + l) B < (l + e) n . (52) 

Since to d (P) < w(P), we deduce u d (P) < (1 + e) n . ■ 

Combining this estimate with Thm. 1 and Lemma 6, we obtain: 

Theorem 2. For every q and e > 0, there exists an effective constant C such 
that 

n 

n m ( M0 , ...,Mn) - <z 2 ™-<" +1 >| < c(i + e )V"-«rj m\i • (53) 

for any n and any distributions fa on k. mm 

In particular, suppose that n = 2m + a for some fixed nonnegative integer a, 
and that all the fa are the same, so that each Xi is chosen from the same distri- 
bution /i. Then, as long as Wfi\\i < q 1 ^ 2 , the error term in ( ^3|) approaches as 
m —* oo, and we conclude that if each of xq, . . . , X2m+a is chosen independently 
from the distribution then x G H m with probability approaching q~^ a+1 \ 
same as for the uniform distribution. As noted in the Introduction, the bound 
on ||/t||i is best possible, at least if q is a square: in that case k has a quadratic 
subfield fcoj and if each x\ is chosen uniformly from kg (or from cko for some 
c G k*) then x G ff m with probability q-( Q + 1 )/ 2 , not <7 _ ( Q+1) ; but for this 
distribution, = q 1 ^ 2 by Lemma 5. 
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Open questions 

Better bounds on U m ([L , ■ • • ,Mn) - (? 2m -(™+ 1 ) ? We showed (Thm. 2) that 
II m (/Uo, • • • j Mn) is well approximated by g 2m -( n +!) under certain hypotheses 
on the Can these hypotheses by weakened by lowering the error bound 
in (p3|)? Of course we must exclude some choices of /i^. For instance we cer- 
tainly cannot have every fii supported on only one point; and we already gave 
the counterexample of uniform distribution on a proper subheld of k. But it 
seems plausible that, except for such pathological cases, (x , . . . , x n ) should be 
about as likely to be in H m with Xi chosen from /i^ as it is with x chosen 
uniformly from W n — whether or not the \\fJ>i\\i are small enough to deduce 
11^,(^0, ■ ■ ■ jMn) ~ q 2m ~( n+1 ) from Thm. 2. For instance we may surmise the 
following 

Conjecture. Fix k and a closed set K of distributions /u : k —>■ R. Assume 
that no (i G K is supported on a single point, nor on cko for any c G k* and any 
proper subfield ko of k. Then, for every real R ^ 2, we have 

n m ( Mo , . . . , M „) = (1 + (l))g 2m -(" +1 ) (54) 

for any sequence of (n, m, fJ®, . . . , [L n ) for which m — > oo, 2m ^ n ^ Rm, and 
Hi G K for each i. 

In particular, suppose q — R = 2. A distribution on k is then a pair (fJ,(0), A*(l)) 
of nonnegative numbers with fi(0) + fi(l) — 1. The conjecture then asserts that, 
for each p > 0, if each entry Xi of a square Hankel matrix of order m + 1 over 
Z/2Z is chosen independently at random with probabilities /ii(0), [ii(l) both 
^ p, then the matrix is singular with probability approaching 1/2 as m — > oo. 
Thm. 2 shows this only for p > 1 - 2" 1 / 2 w 29.3%. 

Higher dimensions. What happens to our theory in the context of arrays 
of dimension 2 or greater, rather than finite sequences? One could start the 
analysis in the same way, using for instance homogeneous polynomials in three 
variables to treat triangular arrays, or bihomogeneous polynomials in two pairs 
of variables for rectangular arrays. The resulting structures will surely be more 
complicated in higher dimensions, but it may still be possible to find tractable 
descriptions. 

Determinants of nonsingular Hankel matrices. In another direction, we 
return to the case n = 2m of square Hankel matrices (0) of order m + 1, for 
which H m consists in effect of such matrices whose determinant vanishes. We 
then ask: is there a formula analogous to ([35|), or even an estimate analogous to 
Lemma 7, for the discrete Fourier transform of the set of square Hankel matrices 
of order m + I with determinant c, for any given nonzero c G kl This is easy 
when q — 2, in which case that set is just the complement of H m . But the 
problem seems to require new techniques once q ^ 3. 
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